The advance of computer-aided detection systems using deep learning opened a new scope in endoscopic image analysis. However, the learning-based models developed on closed datasets are susceptible to unknown anomalies in complex clinical environments. In particular, the high false positive rate of polyp detection remains a major challenge in clinical practice. In this work, we release the FPPD-13 dataset, which provides a taxonomy and real-world cases of typical false positives during computer-aided polyp detection in real-world colonoscopy. We further propose a post-hoc module EndoBoost, which can be plugged into generic polyp detection models to filter out false positive predictions. This is realized by generative learning of the polyp manifold with normalizing flows and rejecting false positives through density estimation. Compared to supervised classification, this anomaly detection paradigm achieves better data efficiency and robustness in open-world settings. Extensive experiments demonstrate a promising false positive suppression in both retrospective and prospective validation. In addition, the released dataset can be used to perform 'stress' tests on established detection systems and encourages further research toward robust and reliable computer-aided endoscopic image analysis. The dataset and code will be publicly available at http://endoboost.miccai.cloud.

The security of artificial intelligence (AI) is an important research area towards safe, reliable, and trustworthy AI systems. To accelerate the research on AI security, the Artificial Intelligence Security Competition (AISC) was organized by the Zhongguancun Laboratory, China Industrial Control Systems Cyber Emergency Response Team, Institute for Artificial Intelligence, Tsinghua University, and RealAI as part of the Zhongguancun International Frontier Technology Innovation Competition (https://www.zgc-aisc.com/en). The competition consists of three tracks, including Deepfake Security Competition, Autonomous Driving Security Competition, and Face Recognition Security Competition. This report will introduce the competition rules of these three tracks and the solutions of top-ranking teams in each track.

Recently, many deep learning based beamformers have been proposed for multi-channel speech separation. Nevertheless, most of them rely on extra cues known in advance, such as speaker feature, face image or directional information. In this paper, we propose an end-to-end beamforming network for direction guided speech separation given merely the mixture signal, namely MIMO-DBnet. Specifically, we design a multi-channel input and multiple outputs architecture to predict the direction-of-arrival based embeddings and beamforming weights for each source. The precisely estimated directional embedding provides quite effective spatial discrimination guidance for the neural beamformer to offset the effect of phase wrapping, thus allowing more accurate reconstruction of two sources' speech signals. Experiments show that our proposed MIMO-DBnet not only achieves a comprehensive decent improvement compared to baseline systems, but also maintain the performance on high frequency bands when phase wrapping occurs.

Scene understanding is an essential and challenging task in computer vision. To provide the visually fundamental graphical structure of an image, the scene graph has received increased attention due to its powerful semantic representation. However, it is difficult to draw a proper scene graph for image retrieval, image generation, and multi-modal applications. The conventional scene graph annotation interface is not easy to use in image annotations, and the automatic scene graph generation approaches using deep neural networks are prone to generate redundant content while disregarding details. In this work, we propose SGDraw, a scene graph drawing interface using object-oriented scene graph representation to help users draw and edit scene graphs interactively. For the proposed object-oriented representation, we consider the objects, attributes, and relationships of objects as a structural unit. SGDraw provides a web-based scene graph annotation and generation tool for scene understanding applications. To verify the effectiveness of the proposed interface, we conducted a comparison study with the conventional tool and the user experience study. The results show that SGDraw can help generate scene graphs with richer details and describe the images more accurately than traditional bounding box annotations. We believe the proposed SGDraw can be useful in various vision tasks, such as image retrieval and generation.

Vision Transformers (ViTs) have achieved state-of-the-art performance on various vision tasks. However, ViTs' self-attention module is still arguably a major bottleneck, limiting their achievable hardware efficiency. Meanwhile, existing accelerators dedicated to NLP Transformers are not optimal for ViTs. This is because there is a large difference between ViTs and NLP Transformers: ViTs have a relatively fixed number of input tokens, whose attention maps can be pruned by up to 90% even with fixed sparse patterns; while NLP Transformers need to handle input sequences of varying numbers of tokens and rely on on-the-fly predictions of dynamic sparse attention patterns for each input to achieve a decent sparsity (e.g., >=50%). To this end, we propose a dedicated algorithm and accelerator co-design framework dubbed ViTCoD for accelerating ViTs. Specifically, on the algorithm level, ViTCoD prunes and polarizes the attention maps to have either denser or sparser fixed patterns for regularizing two levels of workloads without hurting the accuracy, largely reducing the attention computations while leaving room for alleviating the remaining dominant data movements; on top of that, we further integrate a lightweight and learnable auto-encoder module to enable trading the dominant high-cost data movements for lower-cost computations. On the hardware level, we develop a dedicated accelerator to simultaneously coordinate the enforced denser/sparser workloads and encoder/decoder engines for boosted hardware utilization. Extensive experiments and ablation studies validate that ViTCoD largely reduces the dominant data movement costs, achieving speedups of up to 235.3x, 142.9x, 86.0x, 10.1x, and 6.8x over general computing platforms CPUs, EdgeGPUs, GPUs, and prior-art Transformer accelerators SpAtten and Sanger under an attention sparsity of 90%, respectively.

关于对比学习的最新研究仅通过在医学图像分割的背景下利用很少的标签来实现出色的性能。现有方法主要关注实例歧视和不变映射。但是，他们面临三个常见的陷阱：（1）尾巴：医疗图像数据通常遵循隐式的长尾分配。盲目利用训练中的所有像素会导致数据失衡问题，并导致性能恶化； （2）一致性：尚不清楚分割模型是否由于不同解剖学特征之间的类内变化而学会了有意义但一致的解剖学特征； （3）多样性：整个数据集中的切片内相关性已得到明显降低的关注。这促使我们寻求一种有原则的方法来战略利用数据集本身，以发现不同解剖学观点的类似但不同的样本。在本文中，我们介绍了一种新型的半监督医学图像分割框架，称其为您自己的解剖结构（MONA），并做出了三个贡献。首先，先前的工作认为，每个像素对模型培训都同样重要。我们从经验上观察到，仅此单单就不太可能定义有意义的解剖特征，这主要是由于缺乏监督信号。我们通过使用更强大的数据增强和最近的邻居展示了学习不变的两个简单解决方案。其次，我们构建了一组目标，鼓励模型能够以无监督的方式将医学图像分解为解剖特征的集合。最后，我们在具有不同标记设置的三个基准数据集上的广泛结果验证了我们提出的MONA的有效性，该数据在不同的标签设置下实现了新的最新设置。

不利的天气条件（例如阴霾，雨水和雪）通常会损害被捕获的图像的质量，从而导致在正常图像上训练的检测网络在这些情况下概括了很差。在本文中，我们提出了一个有趣的问题 - 如果图像恢复和对象检测的结合可以提高不利天气条件下尖端探测器的性能。为了回答它，我们提出了一个有效但统一的检测范式，该范式通过动态增强学习将这两个子任务桥接在一起，以在不利的天气条件下辨别对象，称为Togethernet。与现有的努力不同，这些努力将图像除去/der绘制为预处理步骤，而是考虑了一个多任务联合学习问题。遵循联合学习方案，可以共享由恢复网络产生的清洁功能，以在检测网络中学习更好的对象检测，从而有助于TogEthERNET在不利天气条件下增强检测能力。除了联合学习体系结构外，我们还设计了一个新的动态变压器功能增强模块，以提高togethernet的功能提取和表示功能。对合成和现实世界数据集的广泛实验表明，我们的togethernet在定量和质量上都超过了最先进的检测方法。源代码可从https://github.com/yz-wang/togethernet获得。

使用隔室模型的多种方法已被用于研究Covid-19的大流行，并且使用这些模型的机器学习方法的使用取得了特别明显的成功。我们在这里提出了一种使用“物理知情的神经网络”（PINN）的变体来分析Covid-19美国开发的可访问数据的方法，该方法能够使用模型的知识来帮助学习。我们说明了使用标准PINN方法的挑战，然后如何对网络进行适当和新颖的修改，即使在我们的信息不完整的情况下，网络也可以表现出色。还评估了模型参数的可识别性方面，以及使用小波变换来降低可用数据的方法。最后，我们讨论了神经网络方法与不同参数值模型合作的能力，以及在估计人群中如何有效测试案例的具体应用，从而通过各自提供了美国州的排名测试。

最近基于神经网络的到达方向（DOA）估计算法在未知数的声源场景上表现良好。这些算法通常是通过将多通道音频输入映射到单个输出（即所有来源的总空间伪谱（SP））来实现的，称为MISO。但是，这种误语算法在很大程度上取决于经验阈值设置和声音源之间的角度大于固定角度的角度假设。为了解决这些局限性，我们提出了一种新型的多通道输入和多个输出的DOA网络，称为MIMO-DOANET。与一般的误觉算法不同，Mimo-Doanet借助于信息的空间协方差矩阵预测了每个声源的SPS编码。通过这样做，检测声源数量的阈值任务成为检测每个输出中是否存在声音源的更容易的任务，并且在推理阶段，声源之间的严重交互消失。实验结果表明，与3，4个来源场景中的莫斯科基线相比，MIMO-DOANET的相对增长18.6％和绝对13.3％，相对34.4％和绝对20.2％的F1得分提高。结果还证明了Mimo-Doanet减轻了阈值设置问题，并有效地解决了角度假设问题。

经常在现实生活中观察到签名网络，并具有与每个边缘相关的其他符号信息，但是在现有网络模型中，这些信息在很大程度上被忽略了。本文开发了一个统一的嵌入模型，用于签名网络，以解散交织在一起的平衡结构和异常效应，这可以极大地促进下游分析，包括社区检测，异常检测和网络推断。所提出的模型通过低等级加稀疏基质分解捕获平衡结构和异常效应，这些分解是通过正则配方共同估算的。它的理论保证是根据渐近一致性和用于网络嵌入，社区检测和异常检测的有限样本概率范围的。还通过在合成网络和国际关系网络上进行广泛的数值实验来证明所提出的嵌入模型的优势。